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SUMMARY 


This  first  of  two  volumes  describes  the  technical  de- 
tails of  a new  technique  for  human  engineering:  SAINT  (Systems 

Analysis  of  Integrated  Networks  of  Tasks).  The  second  volume 
(AMRL-TR-73-128)  is  a user's  manual  for  the  computer  program 
which  analyzes  such  networks. 

SAINT  provides  a graphic  symbol  set  for  diagramming 
event  sequences.  The  network  symbols  developed  for  P-GERT 
(Precedence-GERT,  GERT  being  a Graphical  Evaluation  and  Review 
Technique)  were  used  as  a basis  for  SAINT.  GERT  was  itself 
developed  previously  to  aid  engineers  interested  in  applying 
network  theory  and  simulation  to  operations  and  systems  analysis 
problems.  SAINT  extends  these  capabilities  to  allow  a de- 
scription of  human  activities  in  terras  of  a set  of  tasks  per- 
formed by  a crew  or  set  of  operators. 

The  computer  program  for  analyzing  task/activity 
networks  includes  all  the  human  performance  dynamics  proposed 
by  Siegel  and  Wolf  in  their  two-man  operator  simulation  model. 
However,  because  of  the  enhanced  capabilities  of  the  SAINT 
symbol  set,  many  of  the  model  constructs  Used  by  Siegel  and 
Wolf  have  been  generalized  for  crew  sizes  of  up  to  eleven 
operators.  Although  not  discussed  in  detail,  the  computer 
routines  also  include  the  modifications  made  to  the  Siegel-Wolf 
model  to  permit  a consideration  of  the  impact  nuclear  weapons 
effects  could  have  on  human  performance.  Consequently,  the 
SAINT  routines  can  be  used  as  an  aid  to  determining  the 
vulnerability/survivability  of  manned  systems. 

By  design,  the  SAINT  technique  does  not  require  the 
user  to  perform  any  computer  programming.  Users  are  assumed  to 
be  knowledgeable  of  task  analysis  or  methods  engineering.  The 
results  of  a task  analysis  are  used  as  the  inputs  to  the  SAINT 
computer  program.  The  output  of  SAINT  consists  of  task  and 
mission  performance  estimates. 

The  SAINT  computer  programs  are  coded  in  FORTRAN  IV 
and  should  be  executable  on  almost  any  digital  computer  having 
a FORTRAN  compiler. 

While  the  technique  has  been  developed  to  examine 
human  factors  affecting  the  outcomes  of  military  missions,  the 
technique  is  generally  applicable  to  non-military  activities 
and  should,  therefore,  prove  useful  in  industrial,  trans- 
portation and  consumer  products  studies  of  interest  to  human 
factors  specialists. 
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This  study  was  initiated  by  the  Human  Engineering 
Division,  Aerospace  Medical  Research  Laboratory,  Wright- 
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Man  in  Air  Force  Systems,"  with  funding  provided  from  project 
8809,  "Nuclear  Vulnerability  and  Hardening  Technology,"  task 
880903,  "Analysis  of  S/V  of  Air  Force  Aeronautical  Systems  in 
a Nuclear  Environment."  The  research  sponsored  by  this  con- 
tract was  performed  between  September  1972  and  August  1973, 
under  Air  Force  contract  F33615-73-C-4029. 

Dr.  Arthur  D.  Siegel  of  Applied  Psychological  Services, 
Inc.,  Wayne,  Pennsylvania  19087  is  to  be  thanked  for  his  assist- 
ance and  cooperation  in  this  work  which  extends  the  pioneering 
effort  he  and  his  associates  contributed  under  contracts 
F33615-70-C-1798  and  F33615-69-C-1880  as  well  as  the  Navy- 
funded  development  of  the  original,  two-man,  operator  simulation 
model. 


TABLE  OF  CONTENTS 


SECTION  I - INTRODUCTION  ^ 

Rationale  and  Background  ^ 

Evolution  2 

Design  Philosophy  4 

SECTION  II  - TASK-ORIENTED  CONCEPTS  6 

Task  Input  6 

Task  Duration  . . • 7 , , 

Task  Essentiality 9 

Task  Type  9 

Task  Class  12 

Task  Output  12 

Additional  Task-oriented  Concepts  14 

statistical  Information  Collection  15 

SECTION  III  - OPERATOR- ORIENTED  CONCEPTS  17 

Speed 17 

Accuracy . 19 

Stress  20 

Goal  Gradients  33 

Cohesiveness  34 

Computational  Sequence  34 

SECTION  IV  - SAINT  MODELING. 36 

Branch  Symbolism 39 

Operator  Symbolism  40 

Examples  42 

SECTION  V - SUMMARY  49 

REFERENCES  ; 51 


XV 


LIST  OF  FIGURES 


Figure  Number 


Page 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


Probability  of  Success  Modification 
for  Different  Task  Accuracy  Factors  21 


Probability  of  Skipping  a Task  as  a 
Function  of  Stress  and  Essentiality  32 

Task  Symbol  and  Terminologi’  37 

Branching  Types,  Symbols  and  Terminology  ..  41 


A Series  of  Tasks  by  a Single  Operator  ....  44 

Parallel  Tasks  Leading  to  a Joint  Task 
Involving  Two  Operators 44 

A Joint  Task  Followed  by  Two  Parallel 
Tasks  Involving  Two  Operators  46 

Parallel  Tasks  for  Two  Operators  Sepa- 
rated by  an  Either  Task 46 

Network  Modification  Based  on  Task 
Completion  Sequence  47 


Clearing  of  Operators 


47 


LIST  OF  TABLES 


Table  Number  Page 

1 Z Values  as  a Function  of  Stress  and 

Essentiality  30 

2 Goal  Gradient  Additive  Factor  33 


V 


SECTION  I 


I 

i 

1 


! 

i 


) 


INTRODUCTION 


Human  engineering/  as  an  applied  psychology  of  man- 
machine  relationships  has  attempted  to  apply  the  methods  of 
experimental  psychology  to  the  study  of  human  behavior  in  a 
systems  context.  The  product  of  such  endeavors  has  been  the 
specifioation  of  design  standards/  the  generation  of  data  for 
design  tradeoff  studies,  or  specific  recommendations  concern- 
ing proposed  design  alternatives.  However,  the  achievement  of 
the  implied  objective  - the  support  of  design  and  systems 
engineers  - has  often  been  frustrated  by  the  difficulty  en- 
countered in  translating  human  performance  into  systems 
outcomes.  It  matters  little  that  one  can  design  equipment  or 
procedures  so  they  save  time  or  curtail  hximan  errors  if  these 
benefits  do  not  somehow  manifest  themselves  in  terms  of  mission 
relevant  consequences:  increased  system  effectiveness  and/or 

reduced  cost. 

One  technique  for  accomplishing  such  determinations  is 
simulation.  With  simulation,  the  events  and  activities  as- 
sociated with  man-machine  performance  are  portrayed  in  the 
context  of  the  application  of  interest.  The  systems'  per- 
formance in  a mission  is  represented  by  the  model's  portrayal 
of  man-machine  activities  in  response  to  mission  events. 

The  ability  of  simulation  to  evaluate  hypothetical 
mission  performance  in  some  satisfactory  sense  has  led  to  its 
wide-spread  use.  Simulation  has  been  used  only  on  a limited 
basis  for  human  engineering  design  assessment,  and  the  common 
practice  has  been  to  assume  that  because  each  system  is  unique, 
the  model  for  and  simulation  of  that  system  must  also  be  unique. 
Few  basic  modeling  concepts  have  been  developed  for  use  in 
simulating  manned  systems.  The  carryover  benefits  from  sirau- 
lation-to-simulation  have  been  small  except  for  the  experience 
gained  by  those  who  designed  and  ran  the  studies. 

The  goal  of  the  current  research  is  to  develop  basic  ' 
simulation  concepts  that  would  permit  the  transferral  of 
knowledge  from  one  project  to  another.  It  is  not  the  intent  of 
the  research  to  provide  a tool  or  set  of  concepts  that  will  be 
usable  for  a large  class  of  human  engineering  problems.  The 
objective  is  to  provide  a tool  that  permits  more  realistic 
mission  simulation  of  manned  systems. 

The  set  of  problems  considered  focuses  on  task  allo- 
cation, operator  workload,  and  environmental  stressors.  It  is 
conjectured  that  network  concepts  and  symbols  can  be  developed 
that  will  permit  the  modeling  of  one  or  more  operators  perform- 
ing an  assigned  set  of  tasks  within  the  context  of  a specific 
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mission  and  the  operating  environment  for  a mission.  Once  the 
network  concepts  and  symbols  are  designed,  a simulation  program 
can  be  developed  for  analyzing  mission  performance  as  a 
function  of  operator  and  environmental  variables.  By  defi- 
nition, a mission  is  modeled  as  a network  of  tasks.  Operators 
perform  the  tasks  and  in  so  doing  accomplish  the  objective  of 
the  mission.  A mission  is  completed  when  a specified  end  task 
or  tasks  have  been  completed.  Mission  performance  is  related 
to  which  tasks  are  achieved,  the  manner  in  which  they  are 
achieved,  and  the  times  at  which  they  are  completed. 

Rationale  and  Background 


Communications  in  research  play  a fundamental  role 
especially  when  interdisciplinary  activities  are  involved. 
Mental  images  and  concepts  are  satisfactory  as  long  as  a single 
researcher  is  working  on  a problem.  As  soon  as  two  or  more  in- 
dividuals are  working  together,  a vehicle  for  expressing  one's 
ideas  and  concepts  is  necessary.  The  use  of  networks  or  graphs 
as  communication  vehicles  for  researchers  is  well  established. 
Examples  of  networks  are  circuit  diagrams,  free  body  diagrams, 
signal  flow  graphs,  block  diagrams  and  PERT  networks.  Net- 
works are  models  of  systems.  These  models  may  be  used  for 
communication  purposes  and/or  analysis  purposes.  In  many 
cases  it  is  the  former  purpose  which  is  significant  as  it  per- 
mits a concise,  explicit  definition  of  the  pertinent  concepts 
the  researcher  wishes  to  convey.  Once  a network  is  prescribed, 
effort  can  be  concentrated  on  analyzing  the  system  by  analyzing 
the  network  model.  When  the  network  model  can  be  used  for  both 
descriptive  and  analysis  procedures,  the  researcher  has  a 
significant  tool  at  his  disposal. 

The  huiaan  factors  specialist  has  long  advocated  the  use 
of  operational  sequence  diagrams  (4)*,  function  flow  logic 
block  diagrams  (16)  and  to  some  extent,  models  (5) . Besides 
Siegel  and  Wolf's  early  use  of  Monte  Carlo  techniques  to  simu- 
late operators  performing  discrete  tasks,  there  are  precedents 
for  using  Monte  Carlo  simulation  to  portray  manual  tracking 
tasks  as  well  (1).  What  appears  to  be  required  is  an  inte- 
grating framework  that  not  only  assimilates  and  consolidates 
these  previous  achievements  but  allows  for  the  systematic  en- 
richment of  such  technical  tools. 

Evolution 


Although  there  are  many  projects  that  have  contributed 
to  the  research  reported  herein,  there  were  two  parallel  de- 
velopments that  led  directly  to  the  creation  and  implementation 
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of  SAINT.  A two-man  model  of  operators  performing  a specified 
task  sequence  has  been  developed  by  Siegel  and  Wolf.  "he  con- 
ceptual nature  of  this  model  and  the  history  of  its  develop- 
ment are  well  documented  (11).  A flow  diagram  of  the  PORTION 
IV  program  and  a discussion  of  possible  extensions  to  the  model 
have  also  been  reported  (12).  Modifications  made  to  treat  the 
impact  ionizing  radiation  has  on  performance  are  reported  by 
Cliubb  (3 ) . 

The  significance  of  the  work  of  Siegel  and  his  as- 
sociates '“is  the  concept  of  modeling  a task  in  terms  of  the  task 
type,  operator  characteristics,  environmental  characteristics, 
and  a mission  scenario.  Each  task  is  modeled  as  a discrete 
event,  consuming  time  and  terminating  as  a success  or  failure. 

A computer  pirogram  was  developed  for  simulating  the  set  of 
tasks  in  a mission  to  assess  the  consequences  of  operator 
errors,  skill  proficiency  and  otlicr  factors  on  mission  per- 
formance. Through  this  procedure,  one  could  examine  the  impact 
specific  characteristics  of  tasks,  operators,  and  the  environ- 
ment might  have  on  a mission.  Consideration  is  given  to  the 
time  available  for  the  mission,  the  time  taken  to  perform  a 
task  as  a function  of  stress,  the  probability  of  successfully 
completing  a task  as  a function  of  stress,  operator  proficiency 
(in  terms  of  speed  and  accuracy) , and  the  impact  of  such 
mission  related  stressors  such  as  exposure  to  ionizing  radi- 
ation. Seifert  and  Chubb  (10)  review  a modified  version  of  the 
Siegel-Wolf  model,  illustrating  its  use  for  vulnorability/sur- 
vivability  assessments. 

The  second  major  development  which  contributed  directly 
to  the  evolution  of  SAINT  is  the  Graphical  Evaluation  and  Re- 
view Technique,  GERT.  GERT  is  a generalized  network  technique 
for  analyzing  a network  consisting  of  a set  of  activities. 

Here  activities  are  tasks,  but  GERT  does  not  require  that 
activities  be  tasks.  During  the  1960 's  and  early  '70's,  the 
development  of  GERT  concentrated  on  network  struc':ure  and 
generalized  procedures  for  describing  activities.  Those  develop- 
ments by  Pritsker  are  reported  in  numerous  papers  and  technical 
reports  (6,  7,  8),  and  more  recently  are  documented  in  a book  by 
Whit. .house  (14).  Doth  analytic  and  simulation  techniques  were 
developed  for  analyzing  GERT  networks. 

The  research  and  development  on  GERT  concentrated  on 
the  development  of  graphical  symbols  which  would  permit  the 
modeling  of  diverse  systems  in  network  form.  Thus,  generalized 
branching  procedures,  randomly  distributed  activity  durations, 
network  modification  mechanisms,  logical  requirements  for 
starting  activities,  and  statistical  data  collection  methods 
were  developed  as  integral  parts  of  GERT. 


The  differences  between  GERT  and  the  Siege 1-Wolf  model 
are  both  conceptual  and  mechanistic.  Whereas  GERT  has  complex 
and  sophisticated  network  symbols  and  constructs/  it  has  a very 
aggregate  method  for  describing  the  performance  of  activities. 

On  the  contrary,  the  Siegel-Wolf  model  has  a complex  and 
sophisticated  procedure  for  prescribing  task  performance,  but 
has  a simple  set  of  network  symbols  and  constructs.  Further, 
while  the  GERT  programs  are  written  in  FORTRAN  IV,  they  make 
extensive  use  of  specialized  and  efficient  programming  tech- 
niques whereas  the  Siegel-Wolf  model  is  coded  in  a straight- 
forward manner  in  FORTRAN  IV.  SAINT  was  designed  to  capture 
the  best  features  of  the  Siegel-Wolf  and  the  GERT  models.  The 
version  of  the  Siegel-Wolf  model  selected  for  incorporation 
into  SAINT  is  the  1971  version  (12).  An  activity-on-node 
version  of  GERT  called  Precedence  GERT  (7)  was  selected  for 
incorporation  into  SAINT. 

Design  Philosophy 

The  basic  philosophy  in  designing  SAINT  is  that  ad- 
ditions, modifications  and  deletions  are  to  be  expected.  Be- 
cause of  this,  the  SAINT  computer  program  was  designed  in  a 
modular  form  to  facilitate  adaptation.  The  computer  program  is 
based  on  GASP  IIA  (9)  which  is  well  documented  and  provides  the 
necessary  support  programs  for  a "simulation  which  is  modular 
and  yet  efficient.  GASP  IIA  and,  hence,  SAINT  is  FORTRAN  based 
and  can  be  run  on  most  computers  having  a FORTRAN  compiler. 

A next-event  simulation  philosophy  has  been  adopted. 

All  changes  in  the.  status  of  the  system  occur  when  a task  is 
completed.  During  the  time  interval  from  one  task  completion 
to  thrj  next  task  completion  the  status  of  the  system  remains 
unchanged,  i.e.,  idle  operators  remain  idle,  operators  working 
on  specified  tasks  continue  to  work  on  these  tasks,  etc.  It  is 
only  when  a task  is  completed  that  othor  tasks  can  be  started, 
and  operators  can  be  assigned  to  tasks.  The  word  task  is  used 
here  in  a generic  sense  and  can  include  both  physical  tasks  or 
other  events.  An  example  of  the  latter  is  a programmed  delay  or 
a "clock"  task  that  interrupts  the  performance  of  other  operator 
tasks.  In  this  case,  the  status  change  occurs  at  the  end  of  the 
clock  task  which  can  then  affect  the  status  of  other  tasks  while 
they  are  in  progress. 

To  simplify  the  presentation  in  this  report,  the  concepts 
relating  to  tasks  and  operators  have  been  separated  and  are  pre- 
sented in  Sections  II  and  III,  respectively.  In  Section  IV,  the 
SAINT  modeling  procedures  and  symbol  set  are  presented.  Section 
V then  integrates  the  information  presented  in  Sections  II,  III 
and  IV.  The  end  of  Section  V includes  a summary  and  recommen- 
dations for  future  work. 
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The  detailed  information  for  using  SAINT  is  presented 
in  a companion  report,  Volume  II  (AMRL-TR-73-128)  entitled: 
"SAINT:  User's  Manual"  (15),  which  includes  definitions  and  a 
listing  of  the  FORTRAN  IV  routines.  The  SAINT  computer  pro- 
gram has  been  implemented  on  Purdue's  CDC  6500  and  the  IBM  360 
computer  facility  at  the  Aerospace  Medical  Research  Laboratory. 
The  Aerospace  Medical  Research  Laboratory  may  be  contacted  for 
additional  information  and  assistance  in  implementing  or  using 
these  routines  for  applications  of  interest  to  the  reader. 


5 


SECTION  II 


TASK-ORIENTED  CONCEPTS 


As  drawn  from  the  Siegel-Wolf  model,  the  basic  element 
of  a,  SAINT  network  is  a task.  In  SAINT,  tasks  are  related  to 
one  another  by  precedence  relations.  A precedence  relation 
stipulates  that  a task  can  be  initiated  only  when  some  pre- 
ceding event,  task  or  other  condition  has  occurred.  In  SAINT 
networks,  tasks  are  represented  by  the  nodes  of  the  network 
while  the  precedence  relations  are  represented  by  branches  be- 
tween tasks.  The  precedence  relations  indicate  the  flow  of 
operators  through  the  network  as  well  as  indicating  which  tasks 
can  be  started  based  on  the  completion  of  a particular  task. 

Tasks  can,  when  completed,  modify  the  network  by  the  addition, 
removal,  or  replacement  of  precedence  relations,  tasks,  or  task 
descriptors  (e.g,  the  time  distribution  or  its  parameter  values). 
Thus,  a SAINT  network  consists  of  tasks  which  when  completed 
can  cause  precedence  requirements  for  other  tasks  to  be  satis- 
fied. At  the  seutne  time  SAINT  provides  a mechanism  for  modifying 
the  network  due  to  the  sequence  in  which  tasks  are  performed, 
conditions  obtained  when  a task  is  executed  or  by  contingency 
events  that  affect  what  the  operators  are  obligated  to  do. 

A SAINT  task  has  associated  with  it  an  input  side,  a 
task  description,  and  an  output  side.  The  input  side  of  a task 
specifies  the  number  and  nature  of  predecessor  tasks  that  must 
be  completed  before  the  task  can  be  started  or  "released." 

The  task  description  consists  of  a number  of  parameters  as- 
sociated with  task  performance  and  the  specification  of  the 
kinds  of  statistical  information  to  be  collected.  The  output 
side  represents  branching  to  be  performed  upon  completion  of 
the  task.  This  branching  can  reflect  the  natural  sequence  of 
events  or  it  can  portray  the  outcomes  of  decisions  made  by  one 
or  more  operators. 

Task  Input 

The  input  side  of  a SAINT  task  specifies  the  number  of 
predecessor  tasks  that  must  be  completed  before  the  task  can  be 
started.  It  also  specifies  whether  the  required  number  of 
predecessor  completions  must  all  be  different.  The  conceptual 
discussion  which  follows  is  presented  in  the  abstract  and  may 
be  somewhat  difficult  to  conceptualize  fully  with  one  reading. 

It  is  suggested  that  this  material  be  read  again  after  the 
examples  in  Section  ]V  have  been  reviewed  and  the  reader  is  more 
familiar  with  these  concepts. 

Each  time  a predecessor  task  is  completed  and  the  branch 
representing  the  precedence  relation  is  taken,  a requirement  for 
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starting  the  task  is  satisfied.  The  task  is  released*  for 
starting  when  a specified  number  of  requirements  is  satisfied. 
Thus,  associated  with  the  input  side  of  a task  is  the  number 
of  requirements  to  release  the  task.  Since  tasks  can  be  re- 
leased more  than  once  (i.e.,  feedback  is  permitted),  and  since 
the  first  time  usually  represents  a special  case,  the  design 
of  SAINT  allows  for  two  values  to  be  associated  with  the 
number  of  requirements  to  release  a task:  1}  the  number  of 

requirements  to  release  the  task  for  the  first  time;  and  2)  the 
number  of  requirements  to  release  the  task  after  the  first  time. 

For  the  input  side  of  a task,  a specification  is  also 
made  as  to  whether  all  requirements  for  the  task  must  be 
different  (as  opposed  to  allowing  repeated  occurrences  of  a 
single  predecessor  task)  in  order  for  the  task  to  be  released. 

If  this  is  not  specified,  then  sequential  completions  of  some 
single  predecessor  task  can  be  used  to  satisfy  the  number  of 
requirements  for  a task. 

By  combining  the  two  input  specifications,  various 
logic  operations  can  be  modeled.  The  logic  operation  of  "AND" 
is  modeled  when  the  nxjmber  of  requirements  must  equal  the 
number  of  predecessor  tasks  and  all  of  these  requirements  must 
be  different  tasks.  An  OR  logic  operation  specifies  that  only 
one  predecessor  task  completion  out  of  several  tasks  is  re- 
j‘Jiire,a  to  release  the  task  in  question.  A "Majority  Voting" 
iogic  is  an  operation  which  specifies  that  more  than  half  of 
the  incoming  branches  to  a task  must  be  satisfied  and  that  they 
must  represent  different  task  completions.  As  can  be  seen,  the 
SAINT  model  specifications  permit  a large  degree  of  flexibility 
in  specifying  precedence  requirements. 

Task  Duration 

Task  duration  or  the  time  to  perform  a task  is  charac- 
terized by  both  a distribution  type  and  a parameter  set. 
Sampling  can  be  performed  from  any  of  the  following  distri- 
bution types: 

1.  Constant 

2.  Normal 

3.  Uniform 

4.  Erlang 


* The  term  "released"  is  used  instead  of  "started"  because 
all  predecessor  tasks  can  be  completed  but  the  task  not  start- 
ed due  to  a resource  conflict,  i.e.,  two  or  more  tasks  wanting 
to  use  the  same  resource  at  the  same  time. 
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5.  Lognormal 

6.  Poisson 

7.  Beta 

8 . Gamma 

9.  Beta  fitted  to  three  estimates 

10.  Constant  divided  by  a scale  factor 

11.  Triangular 

In  SAINT,  samples  are  obtained  from  these  distributions 
by  using  whatever  information  the  user  provides  in  a parameter 
set  identified  through  a parameter  set  number.  The  method  for 
doing  so  is  not  discussed  here  but  is  treated  in  Volume  II. 

The  pareuneters  in  a set  detail  such  information  as  the  mean, 
standard  deviation,  minimum  value,  and  maximuni  value  associated 
with  the  distribution.  The  samples  are  obtained  such  that  if 
a sample  is  less  than  the  minimum  value,  the  sample  value  is 
given  the  minimum  value.  Similarly,  if  the  sample  value  is 
greater  than  the  maximum  value,  the  sample  value  is  assigned 
the  maximum  value.  Strictly  speaking,  this  technique  does  not 
provide  sampling  from  a truncated  distribution,  but  rather 
Ssunpling  from  a distribution  with  a given  probability  of  ob- 
taining the  minimum  and  maximum  values. 

Task  duration  is  not  solely  dictated  by  the  sample 
drawn  but  ceui  be  affected  by  operator  characteristics  or  by 
environmental  factors.  Currently,  only  the  degradation  imposed 
by  exposure  to  a nuclear  weapons  environment  has  been  con- 
sidered, but  other  factors  can  be  added  in  future  studies. 
Operator  characteristics  that  have  cin  effect  on  task  duration 
currently  include  the  operator's  speed  and  the  "time  stress"  to 
which  this  operator  is  subject  at  the  time  the  task  is  executed. 
The  method  by  which  these  characteristics  affect  task  duration 
is  discussed  in  the  next  section. 

Task  duration  may  also  be  modified  by  a task  adjustment 
factor.  This  adjustment  factor  is  used  to  reflect  an  increase 
or  decrease  in  the  time  to  perform  a task  if  it  is  repeated. 
Suppose  a task  takes  10  time  units  to  be  performed  and  has  cui 
adjustment  factor  of  0.90.  The  first  time  the  task  is  per- 
formed, its  duration  will  be  10  time  units.  The  second  time  it 
is  performed  it  will  take  10  x 0.90  or  9 time  units.  The  third 
time  it  will  take  10  x 0.90  x 0.90  or  8.1  time  units.  If  the 
same  task  had  an  adjustment  factor  of  1,10,  it  would  take  10  x 
1.10  or  11  time  units  to  perform  the  task  for  the  second  time 
cind  10  X 1.10  X 1.10  or  12.1  time  units  the  third  time.  Thus, 
the  task  adjustment  factor  provides  a basis  for  a continual 
modification  of  task  duration. 

If  a task,  or  operator  performing  a task,  is  subject 
to  radiation  exposure,  or  any  other  performance  degrading 
stressor,  the  task  duration  is  also  subject  to  modification. 
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A complete  discussion  of  the  rationale,  approach  and  method  for 
incorporating  the  effects  of  exposure  to  the  ionizing  radi- 
ation of  a nuclear  weapon  has  been  presented  previously  (3) , 

~ ^ will  not  be  included  in  this  report. 

Task  Essentiality 

Each  task  performed  by  one  or  more  operators  has  as- 
sociated with  it  a graded  essentiality  factor  (12).  The  effect 
of  task  essentiality  is  to  allow,  under  certain  circumstances, 
less-essential  tasks  to  be  skipped  more  frequently  in  the 
interest  of  conserving  time  to  reduce  time  stress.  Task 
essentiality  plays  a role  in  the  simulation  only  when  the  time 
available  to  complete  the  remaining  portion  of  the  mission  be- 
comes critical,  when  time  remaining  is  not  of  a critical 
nature,  all  tasks  are  performed.  However,  when  there  is  in- 
sufficient time  available  after  the  release  of  an  operator- 
constrained  task,  a decision  is  made  whether  to  perform  the 
next  task  or  to  omit  it.  This  decision  is  made  in  accordance 
with  task  essentiality.  In  essence,  the  essentiality  value 
assigned  to  a task  by  the  user  is  a measure  of  hov;  important 
the  user  believes  a particular  task  is  to  overall  mission 
success. 


Currently,  task  essentiality  may  be  graded  on  a scale 
from  zero  to  one  as  suggested  by  Siegel  et  al.  (12).  A task 
with  an  essentiality  of  zero  will  be  performed  only  when  the 
cimount  of  essential  time  remaining  is  less  than  the  remaining 
time  available.* 

However,  if  the  essential  time  remaining  is  greater 
than  the  time  available,  the  task  may  be  skipped.  The  proba- 
bility of  performing  a task  in  this  situation  is  related  to  the 
essentiality  assigned  to  it  as  will  be  discussed  in  the  next 
section.  A task  with  an  essentiality  of  one  will  always  be 
performed.  Thus,  an  essentiality  of  one  indicates  a highly 
essential  task. 

Task  Type 

Each  task  in  a SAINT  network  is  characterized  by  a task 
type.  There  are  six  possible  task  types  in  SAINT; 
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Essential  time  remaining  is  an  estimate  of  the  average 
time  that  would  be  required  to  perform  the  tasks  in  the  remain- 
der of  the  mission  that  are  considered  to  be  essential. 
Remaining  time  available  is  the  difference  between  the  pre- 
scribed mission  completion  time  and  the  current  time. 


9 


S.  Single  operator  task 
J.  Joint  task 
Q.  Equipment  task 
C.  Cyclic  task 
£.  Either  task 
F.  Gap  filler  task 

The  last  two  are  additions  to  the  task  types  recognized  in  the 
Siegel-Wolf  model.  The  task  type  chosen  affects  the  conditions 
under  which  a task  is  performed. 

A "single-operator  task"  is  performed  by  only  one  oper- 
ator. Only  one  operator  may  be  specified  as  being  associated 
with  this  type  of  task.  The  task  is  nob  performed  until  two 
conditions  are  met.  First,  the  precedence  requirements  must  be 
satisfied.  Second,  the  required  operator  must  be  available  to 
perform  the  task.  In  the  current  representation,  an  operator 
can  not  perform  more  than  one  task  at  a time. 

It  should  be  mentioned,  however,  that  an  individual 
need  not  be  represented  by  a single  operator.  It  is  possible 
to  portray  task  activities  of  an  individual  in  terms  of  several 
operators.  This  allows  the  modeler  to  represent  the  oper- 
ations of  vision,  right  and  left  hands,  right  and  left  feet,  •’ 
etc.  as  separate  operators.  This  obviously  requires  a more 
complex  network  model,  additional  data,  and  considerable  at-  * 
tention  to  detail.  The  desirability  of  considering  such 
details  is  left  to  the  discretion  of  the  user  and  must  be  evalu- 
ated in  light  of  the  problem  to  be  solved,  the  resources 
available,  and  other  constraints. 

The  important  point  here  is  simply  that  the  SAINT  con- 
cepts can  be  adapted  to  different  levels  of  description,  and 
the  reader  is  cautioned  against  inferring  that  restrictions 
exist  simply  because  of  the  terminology  used  to  describe  a 
particular  concept.  Once  the  full  import  of  the  concept  is 
properly  perceived,  it  is  often  apparent  that  other  analogies 
can  be  proposed  that  permit  one  to  associate  different  terms 
with  a concept  or  network  symbol.  One's  ability  to  develop 
such  analogies  improves  as  experience  is  gained  in  using  the 
symbol  set  and  sharing  such  experience  with  other  users. 

A "joint"  task  is  similar  to  a single-operator  task  ex- 
cept that  it  is  performed  by  a number  of  operators  working 
together.  Once  again,  all  operators  specified  must  be  avail- 
able before  the  task  can  be  started. 

An  "either"  task  is  performed  by  one  of  a specified  set 
of  operators.  The  first  operator  available  to  perform  the  task 
will  perform  it.  If  two  or  more  operators  become  available  at 
the  same  time,  the  operator  under  least  amount  of  time  stress 
will  perform  the  task.  If  an  operator  arrives  at  an  either 
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task  while  another  operator  is  performing  it,  he  will  skip  the 
task  and  branch  from  the  node  in  a normal  fashion.  If  branch- 
ing is  probabilistic,  the  branch  indicating  successful  com- 
pletion of  the  task  will  be  taken  by  the  operator  who  is  not 
performing  the  task.  The  operator  who  is  performing  the  task 
will  branch  according  to  the  outcome  of  the  task. 

An  “equipment"  task  has  no  operators  associated  with  it. 
Consequently,  the  only  starting  condition  for  an  equipment  task 
is  that  the  required  number  of  predecessor  completions  and  the 
nature  of  these  completions  be  satisfied.  Equipment  tasks  are 
unaffected  by  time  stress  or  other  operator  characteristics 
but  do  affect  how  much  time  has  been  used  out  of  the  total 
amount  allowed. 

A "cyclic"  task  is  used  to  provide  a delay  time  until  a 
following  task  can  start.  It  may  or  may  not  have  operators 
associated  with  it.  However,  the  time  to  perform  a cyclic  task 
is  not  operator  dependent.  A cyclic  task  is  designed  to  end  on 
a specific  cycle.  Once  the  precedence  requirements  for  start- 
ing the  task  have  been  met,  the  time  until  the  next  cycle  is 
determined.  The  time  to  perform  the  task  becomes  the  time 
remaining  to  the  next  cycle.  A cyclic  task  is  used  in  con- 
junction with  a successor  task  that  is  required  to  start  on  a 
prescribed  cycle. 

If  an  operator  is  available  to  perform  a task  where  not 
all  of  the  predecessor  requirements  have  as  yet  been  met,  he 
must  wait  for  the  remainder  of  the  requirements  to  be  satisfied. 
When  this  happens,  th^  operator  is  considered  for  performance 
of  a gap  filler  task.  A gap  filler  task  is  some  activity  which 
ought  to  be  performed  periodically,  time  permitting,  and  is 
typically  executed  as  a fill-in  task  during  periods  where  other 
tasks  cannot  be  executed.  Some  examples  are  making  instrument 
checks  when  the  aircraft  is  on  autopilot,  taking  a coffee  break, 
chatting  with  the  copilot,  etc. 

There  are  two  conditions  that  must  be  met  before  an 
operator  begins  performance  of  a gap  filler  task.  First,  there 
must  be  an  eligible  gap  filler  task  with  the  specification  that 
this  operator  may  perform  it.  Second,  if  other  operators  are 
required  by  the  task  for  which  the  operator  under  consideration 
is  waiting,  their  status  must  be  determined.  If  any  one  of  the 
other  operators  required  are  presently  performing  a gap  filler 
task,  no  gap  filler  task  will  be  started  at  this  time.  How- 
ever, if  this  condition  is  not  met,  and  there  is  an  eligible 
gap  filler  task  for  the  operator  to  perform,  he  will  perform 
that  filler  task. 

A gap  filler  task  is  considered  eligible  to  be  performed 
when  its  starting  conditions  are  met.  There  are  two  conditions 
upon  which  eligibility  is  decided.  First,  an  early  start  time 
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is  specified  for  the  task.  This  indicates  the  earliest  possi- 
ble time  the  task  can  be  performed  for  the  first  time.  The 
second  condition  involves  the  time  of  last  performance  of  the 
task  and  the  minimum  time  specified  between  performances  of  a 
gap  filler  task.  Further,  once  eligibility  has  been  achieved, 
the  task  is  ranked  with  all  other  eligible  gap  filler  tasks 
based  on  the  task  essentiality  specified.  Gap  filler  tasks 
with  high  values  of  essentiality  will  have  a higher  probability 
of  being  performed. 

Task  Class 

A task  may  be  assigned  to  a particular  class,  e.g., 
all  switch  setting  tasks  or  all  visual  tasks,  etc.  This  feature 
is  designed  to  allow  counting  how  often  these  specific  classes 
of  tasks  are  performed.  Any  number  of  tasks  may  be  specified 
as  being  in  the  same  task  class.  In  this  manner,  all  tasks 
that  require  a special  skill  or  are  associated  with  a particu- 
lar control  or  display  can  be  grouped  for  statistical  analysis 
purposes.  These  classes  have  no  defined  meaning  and  may  be 
arbitrarily  defined  for  whatever  purpose  one  has  for  accumu- 
lating such  statistics. 

Task.  Output 

The  output  side  of  a SAINT  task  represents  a branching 
or  decision  operation.  Following  completion  of  a task,  a 
selection  is  made  as  to  which  branches  emanating  from  the  task 
should  be  activated.  The  branching  type  dictates  the  method  by 
which  this  selection  is  made.  The  five  types  of  branching 
operations  included  in  SAINT  are : 

1.  Deterministic 

2.  Probabilistic 

3.  Conditional,  "take  first" 

4.  Conditional,  "take  all" 

5.  Modified  probabilistic 

When  a deterministic  branching  operation  is  specified, 
all  branches  emanating  from  the  task  are  activated.  Thus,  the 
number  of  requirements  for  all  successor  tasks  are  reduced  by 
one.  Essentially,  each  branch  has  a probability  of  one  of 
being  selected. 

For  probabilistic  branching,  each  branch  emanating  from 
the  task  has  an  associated  probability  of  being  selected.  Only 
one  of  the  branches  is  selected,  >ased  on  a random  number  drawn 
from  a uniform  zero-one  distribution.  The  sum  of  the  proba- 
bilities associated  with  the  branches  emanating  from  a task 
with  a probabilistic  output  must  be  1.0. 
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For  a conditional  branching,  "take  first"  operation, 
each  branch  is  specified  with  a condition,  and  the  branches 
are  ordered.  Each  condition  is  tested  in  the  prescribed  order, 
and  the  first  branch  whose  condition  is  satisfied  is  seJ.ected. 
Conditions  may  be  based  on  task  completions  and/or  time.  The 
four  possible  conditions  are: 

1.  specified  task  completed 

2.  time  less  than  or  equal  to  specified  time 

3.  specified  task  not  completed 

4.  time  greater  than  specified  time 

A branch  specified  with  condition  1 is  chosen  only  if  the  task 
specified  has  been  completed  prior  to  the  branching  operation. 
For  condition  2,  the  branch  is  selected  if  the  time  into  the 
simulation  at  the  time  of  branching  is  less  than  or  equal  to 
the  specified  time.  For  condition  3,  the  branch  will  be  se- 
lected if  the  specified  task  has  not  been  completed  prior  to 
the  branching  operation.  For  condition  4,  the  branch  will  be 
taken  if  the  time  into  the  mission  is  greater  than  the  speci- 
fied time.  The  last  branch  emanating  frora  the  task  need  not 
have  a condition.  This  branch  will  be  chosen  only  if  none  of 
the  other,  branches  have  been  selected. 

A conditional,  "take  all"  branching  operation  is  simi- 
lar to  the  conditional,  "take  first"  branching  operation.  Any 
of  the  four  conditions  may  be  specified  for  a branch.  In  this 
case  the  condition  on  each  branch  emanating  from  the  task  is 
evaluated  and  for  every  condition  that  is  satisfied,  the 
corresponding  branch  is  taken.  Once  again,  the  last  branch 
need  not  have  a condition.  When  this  is  the  case,  it  is 
selected  only  if  none  of  the  other  conditions  on  the  branches 
have  been  satisfied. 

Each  branch  emanating  from  a task  with  modified  proba- 
bilistic branching  has  associated  with  it  a probability  and  a 
probability  change.  Branching  occurs  probabilistically  but 
with  the  probabilities  increased  or  decreased  by  the  pre- 
scribed change  multiplied  by  the  number  of  previous 
completions  of  the  task  from  which  branching  is  being  per- 
formed. The  initial  probabilities  must  sum  to  one,  while  the 
probability  changes  must  sum  to  zero.  When  one  of  the  branches 
emanating  from  the  task  has  been  decreased  in  such  a manner  that 
its  probability  of  being  chosen  is  zero,  branching  probabilities 
are  no  longer  modified. 

The  branches  associated  with  both  probabilistic  and 
modified  probabilistic  branching  must  be  ordered  in  such  a way 
that  the  first  branch  represents  the  successful  completion  of 
the  task.  When  a task  is  skipped  and  branching  is  proba- 
bilistic, only  the  successful  branch  will  be  taken. 

Changes  to  the  branching  probabilities  may  also  be  made 
due  to  time  stress,  operator  accuracy,  a goal  gradient,  and 
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radiation  exposure.  The  effects  of  time  stress,  accuracy,  and 
goal  gradient  on  branching  probabilities  will  be  discussed  in 
the  next  section  of  this  report.  A discussion  of  the  effect 
of  radiation  exposure  on  the  branching  probabilities  has  been 
published  in  detail  elsewhere  (3)  and  will  not  be  presented  in 
this  report. 

Additional  Task-oriented  Concepts 

At  the  time  of  completion  of  a task,  changes  to  the  net- 
work structure  and  operator  assignments  can  be  made.  The 
possible  changes  are  network  modification,  parameter  modifi- 
cation, task  clearing,  and  operator  clearing. 

Network  modification  involves  the  substitution  of  the 
characteristics  and  output  side  of  one  task  for  another  task. 

For  example,  the  completion  of  task  7 could  cause  task  10  to 
replace  task  5 in  the  network.  Thus,  when  task  5 is  released, 
task  10  would  be  the  task  that  could  be  started.  Branching 
would  then  occur  from  task  10  when  it  is  completed.  If  task  5 
was  in  progress  when  the  modification  took  place < branching 
would  occur  from  task  10  after  task  5 is  completed.  If  task  7 
was  not  completed  before  task  5 was,  the  outcome  of  task  5 
would  dictate  the  branch  (es)  taken. 

Parameter  modification  is  similar  but  involves  the  sub- 
stitution of  one  parameter  set  for  another  based  on  some  task 
completion.  Once  this  modification  has  been  performed,  the 
task  (or  tasks)  which  previously  used  the  original  parameter 
set  to  generate  performance  times  will  now  use  the  substitute 
set. 


If  it  is  desired  to  halt  a task  in  progress  based  on 
the  completion  of  another  task,  then  a task  clearing  operation 
is  performed.  A task  clearing  operation  halts  the  ongoing 
specified  task  and  assumes  that  the  branches  emanating  from  the 
cleared  task  are  not  taken.  Further,  all  operators  that  were 
working  on  the  cleared  task  are  set  idle. 

Another  feature  of  task  clearing  is  the  reduction  of 
requirements  for  release  at  some  other  task  by  what  is  called 
a signal  operation.  This  signal  operation  acts  as  if  a branch 
has  been  taken  to  the  signaled  task  where  no  branch  actually 
appears  in  the  network. 

Operator  clearing  involves  halting  the  task  in  progress 
that  is  being  performed  by  the  specified  operator.  If  the 
specified  operator  is  cleared  from  a task,  the  task  itself  is 
cleared,  and  all  operators  working  on  the  task  are  set  idle. 

The  signal  feature  that  is  part  of  task  clearing  may  also  be 
specified  in  the  operator  clearing  operation. 


14 


1.  ' ' ] 

i . 'M] 


If  the  operator  to  be  cleared  is  idle  at  the  time  the 
clearing  operation  is  to  be  performed,  no  clearing  occurs. 
However,  if  the  clear  and  signal  feature  is  specified,  the 
signaling  operation  will  take  place.  If  the  operator  is  wait- 
ing for  a task  to  begin,  the  clearing  operation  sets  him  to  idle 
status.  Any  other  operators  waiting  for  the  same  task  are  also 
set  idle.  The  signaling  operation,  if  specified,  is  then  per- 
formed. 

Statistical  Information  Collection 

SAINT  maintains  statistics  on  all  tasks  and  all  oper- 
ators automatically.  SAINT  also  permits  the  user  to  specify 
detailed  information  for  sets  of  mission  iterations.  These  are 
described  in  detail  in  the  SAINT  User's  Manual  (15). 

In  SAINT  there  can  be  multiple  source  and  multiple  sink 
tasks.  A source  task  is  a starting  point  in  the  network  and  is 
the  first  task  to  be  performed  by  an  operator.  A sink  task  is 
one  which  specifies  that  its  completion  can  cause  the  completion 
(realization)  of  the  mission  as  represented  by  the  network, 
i.e.,  one  of  the  sink  tasks  must  be  the  last  task  performed  in 
a mission,  since  probabilistic  branching  is  part  of  SAINT,  all 
sink  tasks  need  not  be  completed  in  order  to  complete  the 
mission.  Thus,  the  nvunber  of  sink  tasks  (one  or  more)  to  com- 
plete the  mission  must  be  defined.  Statistics  are  collected 
for  each  sink  task  which  represent  mission  performance.  In 
addition,  statistics  are  collected  on  tasks  prescribed  by  the 
user.  These  tasks  are  called  statistics  tasks.  For  all  tasks 
on  which  statistics  are  collected,  SAINT  obtains  estimates  of 
the  mean,  steindard  deviation,  minimum,  maximum  and  a histogram 
associated  with  the  time  of  completion  of  the  task.  Five  types 
of  time  statistics  are  possible. 

F.  The  time  of  first  completion  of  the  task; 

A.  The  time  of  all  completions  of  the  task; 

B.  The  time  between  completions  of  the  task; 

I.  The  time  interval  required  to  go  from  the  start  of 
a mark  task  to  the  completion  of  the  task  for  which 
"I"  statistics  are  desired; 

D.  The  time  delay  from  the  first  predecessor  com- 
pletion on  the  task  until  the  task  is  started, 
i.e.,  idle  or  wait  time. 

At  the  completion  of  a statistics  task,  task  class  sta- 
tistics are  collected.  For  each  task  class,  SAINT  obtains 
estimates  of  the  number  of  times  that  tasks  of  the  particular 
class  have  been  performed  prior  to  the  completion  of  the  sta- 
tistics task.  These  estimates  take  the  form  of  the  mean, 
standard  deviation,  minimum,  and  maximum  number  of  times  that 
tasks  of  a particular  class  have  been  performed. 
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This  completes  the  discussion  of  tasks,  their  charac- 
teristics and  the  method  for  integrating  tasks  into  a network. 
In  the  next  section,  operator-oriented  concepts  and  their 
effect  on  task  performance  are  presented. 
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SECTION  III 

OPERATOR- ORIENTED  CONCEPTS 


Operator  characteristics  are  used  in  conjunction  with 
the  task-oriented  concepts  to  make  a mission  operator-specific. 
These  characteristics  serve  to  modify  the  time  to  perform  a 
task  and  the  probability  of  successfully  completing  a task. 

The  characteristics  affecting  operator  performance  currently 
include:  speed,  accuracy,  individual  and  group  stress,  and 

goal  proximity.  The  original  development  of  these  charac- 
teristics was  made  by  Siegel  et.  al.  (11,12)  and  the  material 
presented  herein  is  based  on  their  efforts.  Extensions  have 
been  made  to  consider  cases  where  more  than  two  operators  might 
be  simulated. 

The  original  performance  model  developed  by  Siegel  and 
Wolf  was  dominantly  oriented  toward  the  dynamics  of  workload 
stress.  Initial  work  on  deriving  an  empirically  based  relation- 
ship between  an  operationally  defined  index  of  time  stress  and 
the  task  parameters  (time  and  success  probability)  is  described 
elsewhere  (13)  as  are  the  attempts  to  compare  model  results  to 
field  observations  (12).  No  attempt  is  made  here  to  critique 
either  of  these  efforts  nor  to  modify  any  of  the  proposed  con- 
structs or  relationships.  The  basic  concepts  and  techniques 
used  by  Siegel  and  Wolf  in  implementing  accuracy,  group  stress, 
and  goal  proximity  dynamics  have  been  incorporated  into  the 
SAINT  computer  program.  However,  it  should  be  mentioned  that 
no  effort  has  been  expended  as  yet,  by  Siegel  or  others,  to 
revalidate  these  proposed  refinements  to  performance  models. 
While  such  work  is  obviously  necessary,  it  was  beyond  the  scope 
of  the  present  effort,  which  was  intentionally  restricted  to 
developing  general  programs  for  analyzing  network  models  of 
operator  and  task  dynamics. 

Speed 


Speed  is  intended  to  reflect  one  aspect  of  skill  pro- 
ficiency and  is  an  operator  attribute  that  directly  affects  task 
performance  time  or  task  duration.  The  inclusion  of  a speed 
factor  in  SAINT  allows  for  the  simulation  of  operators  who  might 
be  faster  or  slower  than  an  average  operator. 

The  average  operator  is  assigned  a speed  factor  of 
unity.  Paster  or  more  proficient  operators  are  assigned  a speed 
factor  that  is  less  than  unity.  Their  task  times  are  multiplied 
by  this  factor  and  thereby  reduced.  A speed  factor  that  is 
greater  than  unity  indicates  a less  proficient  operator  that  is 
slower  than  average.  For  example,  if  a task  took  3 seconds  on 
the  average  but  the  operator  was  presumed  to  be  10  percent  less 
proficient  than  average,  he  would  be  assigned  a speed  factor  of 
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1.1  and  for  him,  the  average  task  time  would  be  3.3  seconds 
(3.0  X 1.1)  . 

For  a single  operator  task,  an  either  task  or  a gap 
filler  task,  the  speed  factor  for  the  task,  f , is  the  speed 
factor  for  the  operator  performing  the  task. 

If  there  is  more  than  one  operator  performing  a task 
(i.e.,  a joint  task),  a single  speed  factor  is  computed  in 
order  to  modify  the  task  performance  time.  It  is  assumed  that 
a task  can  only  be  performed  as  qu_ckly  as  the  slowest  oper- 
ator engaged  in  performing  it.  Thus,  the  speed  factor  for  a 
task  involving  multiple  operators  corresponds  to  the  slowest 
operator  working  on  the  task,  and  is  calculated  as 


f.  = max  (f. ) 

^ jeJ(t)  ^ 

where 

fj  is  the  speed  factor  for  operator  j, 

J(t)  is  the  set  of  operators  performing 
task  t 

and  f^  is  the  speed  factor  for  task  t. 


A time  to  perform  the  task  is  generated  using  the 
distribution  type  and  parameter  set  number  associated  with  the 
task.  If  necessary,  this  task  duration  is  also  modified  by  the 
adjustment  factor  and  to  account  for  radiation  and  stress  ef- 
fects. Before  these  other  modifications  are  made,  the  speed 
factor  is  applied  to  make  the  task  duration  operator  specific; 
that  is, 


where 

T is  the  task  duration  before  operator 
speed  is  considered  for  task  t, 

' f^  is  the  task  speed  factor, 

and  is  tne  task  performance  time  with  the 

task  speed  factor  applied. 

When  an  equipment  task  is  being  performed,  no  modifi- 
cation for  speed  is  made  to  task  duration  as  no  operators  are 
associated  with  this  task  type.  Further,  no  speed  adjustment 
is  made  to  the  task  duration  of  a cyclic  task,  even  if  operators 
are  associated  with  it,  due  to  the  nature  of  this  task  type. 
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Accuracy 


Accuracy  is  the  other  aspect  of  skill  proficiency  that 
is  explicitly  treated  and  this  effect  is  included  in  the  suc- 
cess probability  calculation  to  allow  for  operators  who  might 
be  less  accurate  or  more  accurate  than  an  average  operator. 

The  average  operator  has  an  accuracy  value  of  unity.  Those 
operators  who  are  less  accurate  than  average  are  assigned  an 
accuracy  factor  in  the  range  of  1.0  to  1.2.  The  more  accurate 
operator  has  an  accuracy  factor  in  the  range  0.8  to  1.0. 

Upon  input,  the  operator  accuracy  value  is  transformed 
so  that  the  average  operator  has  an  accuracy  factor  of  zero. 

The  less  accurate  operator  is  assigned  an  accuracy  less  than 
zero,  while  the  more  accurate  operator  has  an  accuracy  greater 
than  zero.'  This  transformation  is  performed  by  the  operation; 

, 'il. 

■jI'  ; Uj  = 5(l-aj) 

where 

a.  is  the  assigned  accuracy  factor  for 
^ operator  j 

(0.8  < aj  £ 1.2) , 

and  a.  is  the  transformed  accuracy  factor 
^ for  operator  j 

(-1.0  < a!  £ 1.0)  . 

The  transformed  accuracy  becomes  the  accuracy  factor  associated 
with  the  operator  and  is  used  in  all  calculations  involving 
operator  accuracy. 

If  an  operator  is  performing  a task  alone  (i.e.,  a 
single  operator  task  or  an  either  task) , the  accuracy  value  of 
that  operator  is  used  to  modify  the  probability  of  successfully 
performing  the  task.  If  there  is  more  than  one  operator  work- 
ing on  the  task  (i.e.,  a joint  task),  the  accuracy  used  to 
determine  the  probability  of  success  is  the  value  associated 
with  the  least  accurate  operator.  Thus,  the  calculation  of  the 
task  accuracy  is 


a.  = min  (a^) 
jcJ(t)  ^ 


where 
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J(t)  is  the  set  of  all  operators  per- 
forming task  t, 

and  a^  is  the  task  accuracy  factor. 

A probability  of  success  is  associated  only  with  those 
tasks  which  branch  using  either  the  probabilistic  or  modified 
probabilistic  method.  For  these  tasks,  the  inputted  proba- 
bility of  success  goes  through  a series  of  potential  modifi- 
cations. 


The  order  in  which  the  probability  of  successfully 
completing  a task  is  modified  is  as  follows:  modified  proba- 

bilistic effects;  accuracy  factor;  goal  gradient  effects;  stress 
effects  and  radiation  effects.  The  equations  for  modifying  the 
probability  of  success  due  to  operator  accuracy  are: 


where 


and 


fPt^^t 


Pt  = 


; at  < 0 


Pt  + (l-Pt^^t  '•  ^t  ^ ° 


p,  is  the  probability  of  success  for 

task  t before  accuracy  of  the  operator 
is  considered, 

p’  is  the  modified  probability  of  success 
for  task  t. 


The  probabilities  of  taking  branches  other  than  the  successful 
branch  are  transformed  in  proportion  to  the  change  in  the  suc- 
cess probability.  Figure  1 illustrates  the  probability  of 
success  modification  for  different  task  accuracy  factors. 


On  equipment  tasks  and  cyclic  tasks,  no  operator  ac- 
curacy is  considered  due  to  the  nature  of  these  task  types.  On 
gap  filler  tasks,  no  branching  operation  is  allowed.  Thus,  no 
accuracy  calculation  is  made. 

Stress 


The  workload  stress  on  an  operator  is  viewed  as  a time 
pressure  imposed  on  him  by  a discrepancy  between  the  amount  of 
work  to  be  done  and  the  time  remaining  for  doing  it.  The 
effects  of  this  workload  stress  are  reflected  in  the  operator's 
task  duration  an4  task  success.  The  manner  in  which  the  stress 
is  calculated  and  the  manner  in  which  it  affects  performance 
will  now  be  described. 
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Prior  to  the  start  of  a task  in  which  operator  charac- 
teristics are  to  be  considered  (i.e./  single  operator  tasks, 
joint  tasks,  and  either  tasks),  the  status  of  each  operator 
involved  in  performing  the  task  is  assessed.  The  status  is 
based  on  the  amount  of  time  the  operator  has  available  to  com- 
plete his  assigned  series  of  tasks  over  the  remaining  portion 
of  the  mission,  rhe  average  amount  of  essential  time  and  non- 
essential  time  required  to  finish  all  remaining  tasks  in  the 
mission,  and  the  operator's  speed  factor.  There  are  thus  three 
time  values  to  be  considered:  1}  time  used,  2)  time  available, 

and  3)  time  remaining.  Time  remaining  is  derived  by  calcu- 
lating the  difference  between  time  available  and  time  used. 
Status,  defined  later,  will  be  based  on  time  remaining.  The 
SAINT  user  assigns  each  operator  an  allotment  of  time  for  per- 
forming his  portion  of  the  mission.  Given  this  value  for  time 
availcible,  the  remaining  time  available  is  calculated  by  con- 
sidering the  time  requirements  for  all  essential  and  non- 
essential  tasks  from  the  one  now  being  considered  to  the  task 
that  ends  the  mission. 

The  essential  time  and  non-essential  time  remaining  for 
each  operator  from  the  start  of  each  task  to  mission  completion 
is  either  prescribed  by  the  user  or  calculated  through  a series 
of  benchmark  iterations.  These  benchmark  values  are  derived  by 
simulating  the  task  network  without  any  practical  limit  on  the 
allotted  time  available  for  completing  these  tasks.  In  such 
benchmark  iterations,  the  operators  are  not  constrained,  which 
then  permits  an  estimate  of  the  amount  of  time  necessary  for 
them  to  finish  their  remaining  tasks  irrespective  of  workload 
conditions  or  other  environmental  factors  which  dynamically 
niodify  performance.  The  benchmark  values  provide  a static 
baseline  of  idealized  performance  times  for  task  completion 
under  benign  conditions.  As  the  program  stands  now,  all  per- 
formance dynamics  captured  by  the  Siegel-Wolf  model  are 
oriented  toward  modifying  this  idealized  representation  to  re- 
flect the  realities  of  an  operator's  response  to  contingency 
events,  workload  constraints  and  environmental  variables  which 
may  degrade  performance. 

The  status  of  the  operator  is  now  defined  to  be  in  one 
of  three  states  which  are  determined  by  the  following  con- 
ditions: 


State 

1: 

< TMj  - 

“t 

State 

2: 

i ™j  - 

“t  < ^3 

<Et3  “tj* 

State 

3: 

f .E^.  > TM,  - 
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here 


and 

Thus 


is  the  essential  time  remaining  for 
operator  j at  task  t, 


N.  ■ is  the  non-essential  time  remaining  for 
operator  j at  task  t, 


U.  is  the  time  at  which  task  t is  to  be 
^ started/  i.e.,  the  accumulated  time 
used  on  preceding  tasks 


TM.  is  the  assigned  total  time  available 
^ for  operator  j to  complete  his  portion 
of  the  mission/ 


f j is  the  speed  factor  for  operator  j 

TMj-U^  is  the  calculated  value  for  time  re- 
maining. 


If  E.  . and  N.  . are  not  provided  as  input  data  by  the 

t J C J 

SAINT  user,  they  are  calculated  from  the  benchmark  iterations. 
If  the  operator  is  in  State  1/  he  has  "sufficient"  time  to  per- 
form task  t.  If  the  operator  is  in  State  3,  he  does  not  have 
"sufficient"  time  to  perform  task  t.  If  he  is  in  State  2,  he 
has  "sufficient"  time  to  perform  all  essential  tasks  remaining 
but  not  all  non-essential  tasks  remaining.  Note  that  the 
criterion  of  sufficiency  is  assumed  to  be  a function  of  the 
average  of  the  performance  times. 


The  work  load  stress  for  each  operator  (referenced  to 
his  completing  the  mission)  is  calculated  based  on  the  above 
states.  If  an  operator  is  in  state  1 or  2/  his  stress  is  equal 
to  unity  (no  stress).  If  the  operator  is  in  state  3/  his 
stress  (based  on  time  to  mission  completion)  is 


max  [Ijmin 


[2^ 


TM.-U.  ' 
J ^ 


5.0]] 


where 


Sfi  stress  on  operator  j at  the 

^ start  of  task  t based  on  mission 
completion  at  task  z. 


Many  missions  consist  of  a series  of  segments  or  phases 
Often  the  operations  in  the  segment  are  dominantly  geared  to 
achieving  the  goal  of  that  phase,  relatively  independent  of 
other  subsequent  phases  yet  to  be  completed.  For  example,  if 
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an  aircraft  has  several  weapons,  the  release  of  each  may  be 
important  by  itself,  and  it  seems  reasonable  to  postulate  that 
an  operator's  time  stress  in  a weapon  delivery  is  governed  by 
the  time  available  for  that  mission  phase  rather  than  the  time 
available  for  the  total  mission.  The  end  points  for  such 
mission  phases  may  then  be  taken  as  intermediate  points  where 
time  stress  applies,  and  the  dynamics  of  the  operator's  re- 
sponse to  workload  need  to  reflect  such  considerations. 

The  time  available  for  completing  each  phase  is  as- 
signed by  the  SAINT  user.  These  allotments  may  be  different 
for  each  operator  and  are  specific  to  each  phase.  It  should  be 
pointed  out  that  these  time  allotments  are  meant  to  reflect 
externally  imposed  constraints  on  mission  duration  and  are  not 
directly  related  to  the  task  times.  This  allotment  remains 
fixed.  The  accumulated  time  used  depends  on  the  variability 
in  the  operator's  performance,  how  much  time  was  lost  on  failed 
tasks,  and  other  factors.  Time  remaining  thus  shrinks  as  a 
consequence  of  the  operator's  response  to  conditions  en- 
countered. 

Given  the  assigned  time  available  to  the  operator  for 
reaching  these  intermediate  points,  the  state  of  each  operator 
(relating  to  the  next  intermediate  stress  point  in  his  task 
sequence)  is  calculated  as: 


State 

1: 

State 

2: 

State 

3; 

where 


n is  the  next  intermediate  stress  task  for  operator  j, 

and  TI  . is  the  time  available  for  operator  j to  reach 
^ task  n. 

The  intermediate  stress  on  each  operator  is  calcu- 
lated based  on  the  above  states.  If  an  operator  is  in  state  1 
or  2,  his  intermediate  stress  is  equal  to  unity.  If  an  oper- 
ator is  in  state  3,  his  intermediate  stress  is  calculated  as: 

E.  .-E  . 

s.  .(n)  = max  (If min  [=|J — ; 5.0]] 
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s.  . (n)  is  the  stress  on  operator  j at 
^ the  start  of  task  t based  on  his 
next  intermediate  stress  task. 

For  each  operator  associated  with  task  t,  an  overall 
operator  stress  s^^  is  determined  as: 

s^j  = max  (s^j(z),  (n) ) . 

Thus  if  mission  stress  is  larger  than  segment  (intermediate) 
stress,  intermediate  stress  is  not  used,  but  if  the  inter- 
mediate stress  is  the  larger  of  the  two,  it  is  used  instead 
of  mission  stress. 


For  the  task  under  consideration,  a task  stress  is  de- 
termined as  the  maximum  of  the  overall  stress  values  of  the 
operators  performing  the  task: 


where 


max  (s.  .) 
jeJ(t) 


s^  is  the  stress  for  task  t. 


and  J(t)  is  the  set  of  operators  performing 

task  t. 


The  empirical  literature  on  stress  typically  portrays 
its  impact  as  being  an  organizing  influence  on  behavior  for  low 
values  of  stress  and  a disorganizing  influence  for  high  values. 
Siegel  and  Wolf  portrayed  the  organizing  influence  of  workload 
stress  as  an  improvement  in  task  performance  exhibited  by  a 
decrease  in  the  mean  and  standard  deviation  of  task  times  and 
an  increase  in  the  probability  of  task  success.  Corresponding- 
ly, the  disorganizing  influence  of  stress  was  implemented  as 
a decrease  in  the  probability  of  success  and  an  increase  in  the 
mean  and  standard  deviation  of  task  times.  Ass^ming  the 
functional  relationships  between  stress  and  these  task  at- 
tributes is  given,  the  question  becomes  one  of  deciding  which 
one  to  use;  the  organizing  or  disorganizing  representation. 

To  distinguish  between  these,  Siegel  and  Wolf  utilize  an  oper- 
ator stress  threshold,  M j . If  stress  assumes  a value  equal  to 

or  less  than  M j , stress  is  an  organizing  influence,  but  if 

stress  exceeds  M j , the  influence  is  disorganizing. 
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Once  the  task  stress  has  been  determined,  an  additive 
stress  factor  is  calculated.  This  additive  stress  value  ac- 
counts for  stress  on  other  operators  who  might  affect  the 
performance  of  those  operators  working  on  task  t.  Con- 
sequently, for  each  operator  not  involved  in  the  performance 
of  task  t,  an  additive  stress  factor  is  calculated.  If  an 
operator  not  performing  task  t has  a stress  of  one  (the  mini- 
mum allowed),  his  additive  stress  value  is  zero.  If  his  stress 
is  between  one  and  his  threshold  (stress  improves  task  per- 
formance), the  additive  stress  value  is  determined  as 


where 


and 


Note  that  the  ratio  indicated  in  the  above  equation  is 
greater  than  one  anytime  stress  (s.j)  is  above  threshold  (M^ ) . 

This  implies  that  once  any  operator  not  involved  in  the  task 
exceeds  his  stress  threshold,  the  stress  added  to  the  group 
doing  the  task  is  at  a maximum  value  (1.0).  Depending  on  the 
current  value  of  stress  for  various  members  of  the  group  doing 
the  work  and  their  corresponding  stress  thresholds,  it  is 
possible  that  this  augmented  stress  could  also  induce  their 
exceeding  threshold.  Consequently,  once  a part  of  the  crews' 
behavior  reaches  the  point  of  disorganization,  disorganized 
behavior  may  be  induced  in  others.  While  this  appears  to 
capture  the  nature  of  group  dynamics  under  stress,  continued 
use  of  the  model  and  empirical  tests  will  illuminate  the 
validity  of  this  formulation  and  hopefully  suggest  other 
approaches  if  this  one  proves  inappropriate. 

The  total  task  stress  S^,  is  the  sum  of  the  task  stress 

s^,  and  the  additive  stress,  A^,  i.e.,  = s^  + A^.  Then  is 

used  to  modify  the  task  duration  and  the  success  probability 
for  the  task. 

To  determine  the  effect  of  stress  on  task  performance, 
a task  threshold  level,  M^,  is  calculated  as  the  threshold 

level  of  the  operator  under  the  greatest  stress,  i.e., 

Mt  = 


A,  = max 


S..-1 

Mj-1 


/ 0 1 \ 1 1 


A^  is  the  additive  stress  for  task  t, 

s.  . is  the  stress  on  operator  j at  his 
^ present  mission  location. 
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where 


k is  the  member  of  J(t)  such  that  s^j^  == 

max  (Sx.4) 
jeJ(t)  ^ 

Joint  tasks  are  those  whose  completion  time  is  governed 
by  the  group  doing  the  work,  and  therefore  the  task  ends  when- 
ever the  slowest  member's  performance  contribution  to  that  task 
is  completed.  While  all  the  foregoing  discussion  has  centered 
on  the  group  dynamics  of  stress,  it  is  also  necessary  to  con- 
sider what  threshold  will  be  used  to  determine  whether  the 
ijroup  stress  is  an  organizing  or  disorganizing  influence.  The 
hypothesis  postulated  here  is  that  performance  of  the  group 
will  be  determined  by  the  member  who  is  most  stressed.  If  his 
stress  threshold  is  high,  he  may  prevent  another  member's 
lower  threshold  from  disrupting  the  joint  task  performance;  but 
if  his  threshold  is  low  and  his  stress  high,  then  his  dis- 
organized behavior  will  establish  the  group's  activity.  Again, 
this  representation  appears  reasonable  and  consistent  with  the 
nature  of  a joint  task,  but  further  empirical  test  and  evalu- 
ation is  indicated.  The  effect  of  stress  on  task  performance 
is  a function  of  the  total  task  stress,  S^,  and  the  task 

threshold  level,  M^.  These  effects  will  now  be  discussed. 

Skipping  of  tasks  due  to  stress.  When  ?•  1,  task  t may 

be  skipped  if  its  essentiality,  e^,  is  less  than  1-0.  It  is  pre- 
sumed that  the  probability  of  skipping  a task  is  related  to  e^, 
and  M^.  Let  y^  be  a deviate  drawn  from  a normal  distribution 
with  mean  m,  and  standard  deviation,  a. 

where  y = 


and  0 = 

The  rule  for  skipping  task  t 

if  y^  — ®t'  ^ will  be  performed? 

and  if  > e^,  task  t will  be  skipped. 


0.15. 
is : 
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The  probability  that  task  t is  skipped  is  given  by 


1 00 

P [task  t is  skipped]  = Ply^  ^ “ T^tF  ® 

z 

where  z = (e^  - y)/a  . 

It  is  seen  that  smaller  values  of  (e^  - y)  yield  higher  proba- 
bilities of  skipping  a task  for  a given  value  of  a. 

This  particular  formulation  has  no  empirical  basis,  and 
it  may  be  of  interest,  therefore,  to  examine  more  carefully  the 
manner  in  which  the  operation  is  performed.  First,  the  value 
for  the  mean  (y)  will  vary  not  only  as  stress  (S. ) varies  but 
as  the  stress  threshold  (M^)  varies.  Second,  this  stress 

threshold  depends  on  the  members  of  the  group  performing  the 
task,  if  it  is  a joint  task.  Consequently,  to  make  the  demon- 
stration simple,  it  will  be  assumed  that  the  task  involves  a 
single  operator.  Further,  since  a stress  threshold  value  of 
2.3  has  most  often  been  used  in  previous  simulations,  that 
value  will  be  used  in  calculations  here. 

Table  I shows  the  z values  corresponding  to  different 
stress  levels  for  each  level  of  essentiality.  Figure  2 illus- 
trates how  the  probability  of  skipping  a task  increases  with 
stress  for  each  of  10  non-zero  essentialities.  An  increase  in 
the  value  of  Mj  (or  correspondingly,  in  will  shift  these 

curves  to  the  right  and  a decrease  in  will  shift  them  to  the 
left,  such  that  for  a lower  stress  threshold  increasing  stress 
will  more  often  lead  to  an  operator's  skipping  non-essential 
tasks . 


Effect  of  Stress  on  Time  to  Perform  Task  t.  Stress 
affects  the  task  duration  depending  on  the  total  task  stress 
value.  Let  T^  be  the  task  duration  after  stress  is  considered 
and  T^  the  task  duration  prior  to  stress  consideration.  If 

< M^,  then: 

T[  = T^  (-1.829  + 3.7422  - 2.35075  X + 1) 


where 


S^-1 


If  + 1,  then: 


Ti  - (2S^-2M^+1)  - (S^-M^)„^ 


where 


m.  is  the  mean  of  the  task  performance  time  distri- 
^ but ion. 


If  + 1,  then: 


The  above  equation  forms  are  equivalent  to  those  used  in  the 
Siegel-Wolf  model  (8) , the  first  being  empirically  derived  (a 
least  squares  regression  analysis  of  a laboratory  study  of 
time  stress)  whereas  the  others  are  conceptual  in  nature. 


Effect  of  Stress  on  Probability  of  Success.  Stress  also 
affects  the  probability  of  successfully  completing  a task,  p^, 

depending  on  the  total  task  stress  value.  If  < M^,  then 


Pt  = 


Pt(Mt-St)  + S^-1 
- 1 


If  + 1,  then 

P^.  = (Pt“i)  (V^t^  Pt 

If  + 1,  then 

Pt  = <*^^Pt 

If  the  modified  success  probability,  p^,  becomes  greater  than 
1,  it  is  set  to  1.  If  it  drops  below  Of  it  is  set  to  zero. 

The  probabilities  of  taking  branches  other  than  the  successful 
branch  are  modified  in  proportion  to  the  success  probability 
modification.  Once  again,  the  equation  forms  used  in  SAINT 
for  the  success  probability  modification  are  equivalent  to 
those  used  in  the  Siegel-Wolf  model  (12) . 
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Goal  Gradients 


The  goal  gradient  effect  or  so-called  “end  spurt"  is 
a concept  which  represents  an  increase  in  performance  caused 
by  the  proximity  to  a goal  or  end  point.  In  the  Siege 1-Wolf 
model  as  in  SAINT,  this  is  modeled  through  an  increase  in  the 
probsibility  of  success  for  a specified  percentage  of  the  later 
tasks  in  a mission  segment  that  have  a stress  equal  to  unity 
(no  streLS).  The  goal  gradient  value  prescribed  for  each 
operator  indicates  the  percentage  of  mission  completion  required 
before  the  goal  gradient  may  take  effect.  This  percentage  may 
be  no  less  than  75  per  cent. 

The  task  goal  gradient  value  is  set  to  the  highest 
value  associated  with  einy  operator  performing  the  task.  The 
goal  gradient  effect  is  shown  in  tabular  form  in  Table  II.  The 
goal  gradient  augmentation,  g.  , for  the  task  is  added  to  the 
success  probability  to  arrive^at  a new  probability  of  success 
as : 


Pt  = Pt  9t  ■ 

If  the  SAINT  user  believes  this  construct  does  not 
apply  to  the  situation  being  represented,  a goal  gradient 
value  of  zero  may  be  used,  indicating  this  additive  factor  is 
to  be  considered  only  when  the  mission  is  completed,  i.e., 
effectively  not  considered  at  all.  Further,  the  value  obtain- 
ed for  p^  is  not  allowed- to  exceed  1.0,  so  if  p^  is  close 
enough  to  1.0  the  impact  of  g.  may  be  less  than  indicated  by 
the  tabled  values,  but  in  that  case  virtually  perfect  perfor- 
mance is  assured,  subject  to  other  manipulations  occurring 
subsequent  to  considering  the  goal  gradient. 

Table  II 

Goal  Gradient  Additive  Factor 


Per  Cent  Mission 
Completed 


Success  Probability 
Augmentation  g^ 


75.0 

77.5 

80.0 

82.5 

85.0 

87.5 

90.0 

92.5 

95.0 

96.0 

97.0 

98.0 

99.0 
100.0 


0 

0.004 

0.008 

0.012 

0.017 

0.022 

0.028 

0.036 

0.045 

0.051 

0.059 

0.069 

0.082 

0.100 
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Cohesivenesa 


Cohesiveness  is  a stress-oriented  statistic  collected 
on  each  task  for  which  task  stress  calculations  are  made.  The 
index  of  cohesiveness  is  an  attempt  to  measure  the  joint  stress 
condition  of  the  entire  mission  crew.  It  is  only  an  indicator 
and  is  not  used  to  modify  mission  performance. 

For  each  operator  not  involved  in  the  performance  of 
task  t,  an  index  of  cohesiveness  is  calculated  as  follows: 

c.  = * ^ for  j ^ J(t). 

3 M,  M.-l 
J 

The  index  of  cohesiveness  for  the  task  is  then  assigned  the 
largest  index  of  any  operator  not  associated  with  the  task, 

X • 6 ■ / 


= max  (c.) 
j^J(t) 

As  can  he  seen,  if  the  task  stress  and  the  stress  on 
the  selected  external  operator  are  both  1 (no  stress  condition) , 
the  value  of  the  index  is  0.  When  both  stresses  are  equal  to 
their  corresponding  thresholds,  the  index  value  is  1.  Thus, 
the  lower  the  index  value,  the  greater  the  team  harmony,  or 
cohesion. 

Computational  Sequence 

Basically,  two  dependent  variables  are  used  to  define 
task  performance:  task  duration  and  probability  of  success- 

fully completing  the  task.  Throughout  this  section,  the 
independent  variables  were  presented.  For  each  relation,  the 
modifications  involved  in  the  dependent  variables  was  specified 
in  terms  of  a previously  computed  value  for  the  dependent 
variable.  The  order  in  which  these  modifications  are  made, 

i.e.,  the  computational  sequence,  is  shown  below: 

Task  Duration 


1.  Speed  Factor  (as  a function  of  the  proficiency 
of  team  members). 

2.  Adjustment  Factor  (as  a function  of  number  of 
task  completions). 

3.  Workload  Stress  Considerations  (as  a function  of 
time  remaining  versus  time  required) . 

4.  Radiation  Effects  (as  a function  of  the  duration 
and  level  of  exposure). 
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Probability  of  Success 


1.  Modified  ProLabilistic  Branching  Effects  (if 
appliccible  to  this  task). 

2.  Accuracy  Factor  (as  a function  of  the  pro- 
ficiency of  team  members). 

3.  Goal  Gradient  (if  deemed  appropriate  and 
applicable  at  this  stage  into  the  mission) . 

4.  Stress  Considerations  (as  above). 

5.  Radiation  Effects  (as  above). 

This  completes  the  presentation  of  operator-oriented 
concepts  and  how  they  affect  task  performance.  A modular  de- 
sign has  been  maintained  in  SAINT  to  allow  for  different 
operator  characteristics  and  for  the  adaptation  and  extension 
of  the  concepts.  This  flexibility  should  enhance  the  use  of 
SAINT  and  allow  different  users  to  refine  their  representation 
of  operator  and  group  dynamics  as  they  accumulate  empirical 
data.  In  the  next  section,  the  graphical  concepts  that  are 
used  to  portray  a SAINT  model  are  presented. 


SECTION  IV 


SAINT  MODELING 


A four-step  procedure  is  recommended  when  using  SAINT 
to  model  and  analyze  a mission  composed  of  tasks  and  operators. 
The  first  step  is  to  use  the  SAINT  concepts  and  symbolism  to 
develop  a network  model.  The  second  step  is  to  translate  the 
network  model  into  a data  input  set  for  the  SAINT  program. 

This  is  accomplished  by  using  the  SAINT  input  description. 

The  third  step  is  the  simulation  of  the  network  by  the  SAINT 
program.  The  final  step  is  to  analyze  the  statistical  re- 
sults obtained  from  the  SAINT  program.  Steps  2,  3/  and  4 
are  discussed  in  the  SAINT  User*  s Manual  (15) . The  discussion 
in  this  section  will  concentrate  on  modeling  and  the  graphical 
symbolism  that  is  an  integral  part  of  SAINT. 

The  symbols  to  model  a mission  using  SAINT  are  illus- 
trated in  Figure  3.  The  requirements  for  starting  a task  are 
shown  on  the  input  side  of  a node.  The  number  of  requirements 
for  starting  a task  the  first  time  is  on  the  top  (R. ) cind  the 
requirements  for  starting  a task  after  the  first  time  are 
shown  on  the  bottom  (R,) • The  description  of  the  task  is 
graphically  portrayed  by  a rectangle  which  is  subdivided  into 
six  squares.  In  each  square,  a value  or  symbol  is  placed  to 
indicate  the  type  of  task,  the  features  which  determine  the 
time  required  to  perform  the  task,  and  the  statistical  infor- 
mation to  be  collected  at  the  task.  The  output  side  of  a node 
contains  the  task  number  which  is  the  node  label.  The  shape  of 
the  output  side  of  the  node  indicates  the  type  of  branching  to 
occur  from  the  node.  Branching  from  a task  is  the  means  by 
which  potential  successor  tasks  are  identified. 

The  number  of  requirements  for  starting  a task  is 
specified  on  the  input  side  of  the  node.  Shading  on  the  input 
side  indicates  that  each  requirement  must  be  from  a different 
predecessor  task,  for  both  first  and  subsequent  task  release. 
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Network  modification  involves  the  substitution  of  the 
task  description  and  output  side  of  one  task  for  those  of  an- 
other task. 
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tp  T k 


td  fc  b.S 


N task  nvunber 


number  of  releases  required  iui  first  release  of  task  N 


number  of  releases  required  for  subsequent  release  of 
^ task  N 


t time  descriptors : 


tp  parameter  set  number 


t^  distribution  type 


T task  type : 


single  operator  task 


joint  task 


either  task 


Q equipment  task 


cyclic  task 


F gap  filler  task 


E task  essentiality  (0  £ E 5 1) 


task  class 


task  adjustment  factor 


S task  involved  in  data  collection  such  as  a mark  node 


(S=M)  or  a statistics  node  (S  = F,  A,  B,  I,  or  D) 


Figure  3.  Task  Symbol  and  Terminology 
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The  above  illustration  indicates  that  task  9 vrill  be  substi- 
tuted for  task  8 upon  completion  of  task  2. 

Parameter  modification  involves  the  substitution  of 
one  parameter  set  for  another  based  on  a task  completion. 


The  above  illustration  indicates  that  parameter  set  10  is  re- 
placed by  parameter  set  11  upon  completion  of  task  5. 

Below  the  central  (task  description  portion  of  the 
task,  a rectangle  is  placed  if  a clearing  operation  is  to  take 
place  upon  completion  of  the  task  under  which  it  appears. 

The  right-hand  portion  of  the  rectangle  is  used  if 
other  tasks  can  be  interrupted  or  cleared  while  in  progress 
upon  completion  of  the  task  under  which  it  appears.  When  a 
task  is  cleared,  SAINT  allows  the  number  of  requirements  for 
other  tasks  to  be  reduced.  This  allows  the  starting  of  other 
tasks  in  the  network  when  a task  is  halted  in  progress.  In 
addition,  the  operator  (or  operators)  performing  the  cleared 
task  is  made  available  and  can  be  reassigned  to  another  task  in 
the  same  manner  as  when  a task  is  completed.  First  consider 
the  clearing  of  a task. 
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The  task  symbol  above  indicates  that  task  10  is  to  be 
halted  in  progress  when  task  7 is  completed.  In  addition,  once 
the  clearing  of  task  10  has  taken  place,  the  number  of  require- 
ments for  task  21  is  reduced  by  one. 

The  left-hand  portion  of  the  lower  rectangle  is  used 
if  operators  are  to  be  cleared  upon  task  completion.  If  Uie 
operator  to  be  cleared  ;.d  presently  performing  a task,  then  the 
entire  task  is  cleared,  i^ll  operators  performing  the  task  are 
made  available  for  reassignment  to  another  task,  as  in  task 
clearing.  If  the  operator  to  be  cleared  is  waiting  for  a task 
to  start,  then  all  operators  waiting  for  the  task  are  made 
available  for  reassignment.  If  the  operator  to  be  cleared  is 
not  assigned  to  a task,  no  clearing  need  be  performed.  When  an 
attempt  is  made  to  clear  an  operator,  SAINT  allows  the  number 
of  requirements  for  other  tasks  to  be  reduced,  as  in  task 
clearing.  The  clearing  of  operators  1 and  2 is  indicated  by 
the  following  symbols 


This  symbol  indicates  that  operator  1 is  to  be  cleared 
when  task  12  is  completed,  followed  by  the  reduction  of  the 
number  of  requirements  for  task  15  by  one.  In  addition,  oper- 
ator 2 is  to  be  cleared  and  the  requirements  for  task  27  are  to 
be  reduced  by  one. 

Breuich  Symbolism 

The  branches  of  the  network  are  the  lines  between  the 
nodes  of  the  network.  The  parameters  of  a branch  depend  on  the 
type  of  branching  being  performed.  The  symbols  used  for  each 
branching  type  are  shown  in  Figure  4.  The  number  of  parameters 
and  the  parameter  definitions  for  each  branching  type  are  given 
below: 
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Branching 

Type 


Deterministic 
Probabilistic 
Conditional,  Take  First 
Conditional,  Take  All 


Modified  Probabilistic 


1 

Parameter 

Definition 

1 2 

- 

- 

Probability 

- 

Condition 

Value 

1.  specified  task 

1.  task 

completed 

number 

2.  time  less  than 

2.  speci- 

or  equal  to 

fied 

specified  time 

time 

3.  specified  task 

3.  task 

not  completed 

number 

4.  time  greater 

4.  speci- 

than  speci- 

fied 

fied  time 

time 

Probability 

Change  in 

proba- 

bility 

Examples  of  the  parameter  specifications  are  shown  in 
Figure  4.  Below  the  branch,  a number  in  a triangle  is  used  to 
indicate  the  operator  or  operators  traversing  the  branch.  In 
some  cases,  the  operator  number  will  not  be  indicated  as  it  is 
clear  from  the  network  which  operator  is  traversing  the  branch. 

Operator  Symbolism 

Operators  flow  through  the  network  and,  in  so  doing, 
perform  tasks.  Operator  or  operators  are  identified  with 
branches  by  placing  a triangle  below  the  branch  with  the  oper- 
ator number  in  the  triangle.  There  is  no  need  or  requirement 
to  indicate  the  operator  performing  a task  as  this  can  be 
determined  from  the  incoming  branches  to  the  task  and  the  task 
type.  SAINT  automatically  maintains  operator  status  and  the 
tasks  that  have  been  released  to  which  the  operator  can  be 
assigned.  Operators  are  assigned  to  gap  filler  tasks  on  the 
basis  of  task  essentiality. 
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1.  Deternlnltelc  Branching 


5.  Modified  Probabilistic  Branching 


Figure  4.  Branching  Types,  Symbols  and  Terminology 
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The  characteristics  of  an  operator  are  illustrated 
graphically  as  shown  below; 


where  j is  the  operator  number  or  label/ 

f j is  the  speed  factor  for  operator  j , 

3j  is  the  accuracy  factor  for  operator  j , 

and  Mj  is  the  stress  threshold  for  operator  j. 

The  initial  task  to  which  the  operator  is  assigned  is  pointed 
to  by  the  above  symbol.  The  operator  symbol  and  pointer  are 
not  considered  to  be  a node  or  branch  of  the  network. 

Examples 


The  examples  presented  herein  will  be  kept  small  so 
that  the  modeling  features  contained  within  SAINT  can  be  demon- 
strated. Throughout  the  examples,  only  the  pertinent  infor- 
mation regarding  the  feature  being  demonstrated  will  be 
included.  No  attempt  will  be  made  to  illustrate  all  the 
features  available  within  SAINT.  In  fact,  the  discussion  will 
concentrate  on  the  network  modeling  features  since  general 
discussions  of  the  operator  and  task  parameters  have  been 
discussed  elsewhere. 

No  attempt  is  made  to  rationalize  the  examples  present- 
ed by  suggesting  the  kinds  of  task  situations  where  the  repre- 
sentation described  would  be  useful.  This  is  left  to  the 
imagination  of  the  user.  Often,  the  best  approach  is  to  start 
with  a simple  diagram,  not  using  all  of  the  symbols  at  first 
but  simply  laying  out  the  path  of  normal  activity,  assuming  no 
contingency  events  or  other  complications  occur.  As  this  is 
done,  areas  believed  to  require  special  treatment  later  can  be 
marked  to  call  attention  to  the  fact  that  the  symbols  might 
need  review  and  modification.  One  of  the  more  common  mis- 
takes made  is  to  try  being  too  detailed  in  the  first  attempts 
to  use  the  symbols.  As  experience  is  gained,  the  us  •’fulness 
of  the  symbols  and  features  of  SAINT  will  become  more  ap- 
parent, but  this  requires  discovery  through  application. 
Hopefully,  the  following  discussion  is  adequate  to  suggest  the 
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general  nature  of  the  symbols  and  ways  in  which  they  might  be 
used.  The  treatment  is  neither  unique  to  any  specific  use  nor 
exhaustive  of  the  uses  one  may  have  for  combining  the  symbols. 

In  Figure  5r  a series  of  tasks  to  be  performed  by  a 
single  operator  is  shown.  The , triangle  at  the  beginning  of  the 
network  indicates  that  operator  1 is  to  start  at  task  2. 

Operator  1 has  a speed  factor  of  0.9/  an  accuracy  factor  of 
1.0/  and  a stress  threshold  of  2.5.  Task  2 is  a single  oper- 
ator task  and  a source  task.  Source  tasks  are  indicated  by 
having  zero  requirements  for  their  first  release,  (R^  =0). 

An  adjustment  factor  of  0.8  is  associated  with  task  2.  Branch- 
ing from  task  2 is  probabilistic  with  the  branch  from  2 to  3 
being  the  successful  branch.  This  is  indicated  with  a plus 
sign  attached  to  the  probability  of  going  from  node  2 to  node 
3.  The  probability  that  the  operator  did  not  successfully 
accomplish  the  task  is  0.1  and  is  indicated  on  the  feedback 
branch  around  task  2.  Note  that  for  subsequent  releases  of 
task  2,  one  requirement  is  specified.  If  task  2 is  failed,  it 
is  performed  again,  and  the  time  to  perform  it  is  modified  by 
the  adjustment  factor  (0.8).  This  factor  would  continue  to 
be  applied  for  each  subsequent  failure  and  re-execution  of 
task  2.  In  both  branches  emanating  from  task  2,  operator  1 
is  assigned,  and  a small  triangle  with  a 1 inside  of  it  is 
placed  beneath  both  branches  emanaging  from  task  2.  Task  3 
is  a single  operator  task  similar  to  task  2.  For  task  3, 
branching  is  modified  probabilistic  which  indicates  that  there 
is  a changing  probability  associated  with  the  bran  .ling  from 
task  3.  In  this  case  the  probability  of  successfully  com- 
pleting the  task  is  .5  which  would  result  in  operator  1 being 
sent  to  task  4.  Each  time  task  3 is  failed  and  then  repeated, 
this  success  probability  is  increased  by  0.1.  Task  4 repre- 
sents the  last  task  of  the  network  and  statistics  describing 
task  4 would  relate  to  mission  or  network  performance. 

The  next  example  involves  two  operators  who  are  required 
to  complete  their  mission  in  20  hours.  The  network  representing 
the  mission  is  shown  in  Figure  6.  Operator  1 starts  at  task  1 
and  operator  2 at  task  2.  Following  tasks  1 and  2,  operators 
1 and  2 must  work  together  on  task  3.  Task  3 is  a joint  task 
(T  = J)  and  has  two  requirements  before  it  can  be  started,  one 
for  each  operator.  Branching  from  task  3 is  conditional,  take 
first.  The  branch  from  3 to  4 is  taken  if  the  current  time  is 
less  than  or  equal  to  20  (condition  2).  Both  operators  1 and  2 
are  then  transferred  to  task  4 which  represents  the  mission 
being  completed  on  time.  If  the  time  of  completion  of  task  3 
is  greater  than  20  (condition  4)  then  branching  to  task  5 occurs 
and  the  mission  is  not  completed  on  time.  In  an  enlarged  treat- 
ment of  a mission,  other  activities  could  then  represent  what 
the  crew  does  from  this  point  on;  re-execute  an  attack,  go 
home,  etc. 
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Figure  6.  Parallel  Taaks  Leading  to  a Joint  Task 
Involving  Two  Operators 
44 


The  network  in  Figure  7 illustrates  the  situation  where 
two  operators  start  on  the  same  task,  and  then  work  on  separate 
tasks.  Task  10  is  a joint  task  and  since  both  operators  are 
initially  set  at  task  10,  task  10  requires  operators  1 and  2. 
Branching  from  task  10  is  deterministic  and  causes  the  number 
of  requirements  for  tasks  11  and  12  to  be  reduced  by  1.  Since 
only  one  requirement  exists  for  each  task,  the  tasks  are  re- 
leased. Operator  1 is  sent  to  task  11  and  operator  2 is  sent 
to  task  12  as  indicated  by  the  numbers  in  the  triangles  below 
the  branches. 


Figure  8 presents  a network  involving  two  operators  who 
at  first  are  performing  tasks  in  parallel.  The  first  operator 
that  completes  his  task  performs  task  3.  Since  task  3 is  an 
either  task,  either  one  of  the  operators  may  perform  it.  If 
task  3 is  being  performed  by  operator  1 when  operator  2 arrives 
to  perform  the  task,  operator  2 goes  directly  to  task  5 and 
would  start  it.  If  operator  2 arrives  after  task  3 was  com- 
pleted by  operator  1,  operator  2 performs  task  3 over  again. 

(If  this  was  not  desired,  the  network  modification  feature  of 
SAINT  should  be  used;  then  task  3 should  be  modified  baaed  on 
the  completion  of  task  3.)  An  analogous  situation  occurs  if 
operator  2 arrives  at  task  3 first.  Branching  from  task  3 is 
deterministic,  and  operator  1 is  sent  to  task  4 when  he  com- 
pletes task  3 and  operator  2 is  sent  to  task  5 when  he 
completes  task  3. 

The  next  example  shown  in  Figure  9 illustrates  the 
modification  of  a network  based  on  the  task  completion  sequence. 
Since  only  one  operator  is  involved,  there  is  no  need  to  in- 
dicate the  operator  number  beneath  the  branches  of  the  network. 
Branching  from  task  2 is  probabilistic  and,  therefore,  either 
task  3 or  4 is  released  following  the  completion  of  task  2, 
according  to  the  probabilities  shown.  If  task  3 is  performed, 
then  task  5 is  released  (only  one  requirement  exists)  and  task 
5 would  be  started.  If  task  4 is  performed,  then  task  6 re- 
places task  5 in  the  network,  and  task  6 is  released  and 
subsequently  started. 

The  last  example,  shown  in  Figure  10,  illustrates  the 
clearing  of  operators.  Two  operators  are  involved  in  the 
mission,  one  starting  at  task  20  and  the  other  starting  at  task 
21.  As  soon  as  one  of  the  operators  finishes  his  task,  it  is 
desired  to  start  task  22,  a joint  task  requiring  both  operators. 
This  is  accomplished  by  clearing  operator  2 from  task  21  when 
task  20  is  completed  prior  to  task  21,  and  signaling  task  22. 
This  signal,  plus  the  branch  from  task  20  to  task  22  then 
causes  task  22  to  be  released.  The  clearing  of  operator  2 
makes  him  available  to  perform  task  22.  The  completion  of  task 
20  by  operator  1 makes  operator  1 available  for  performing  task 
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22  and,  hence,  task  22  is  started.  If  task  21  was  completed 
prior  to  task  20,  the  opposite  situation  pertains  and  the 
clearing  of  operator  1 is  performed  and  a signal  to  task  22  is 
sent. 

The  above  examples  illustrate  the  flexibility  in  model- 
ing a/ailable  from  the  SAINT  symbol  set.  Not  all  capabilities 
were  shown  in  the  above  examples,  but  hopefully  the  flavor  of 
the  modeling  procedure  was  presented.  The  analysis  obtained  by 
the  SAINT  computer  program  is  presented  in  the  SAINT  User's 
Manual  (15)  where  the  analysis  of  a large  example  network  is 
presented  in  detail. 


SECTION  V 


SUMMARY 


A general  framework  has  been  presented  for  modeling  and 
analyzing  crew  performance.  The  modeling  vehicle  developed  is 
a set  of  network  symbols  and  terminology  and  the  analysis  tech- 
nique is  simulation.  The  combined  network  modeling  and 
simulation  technique  is  called  SAINT. 

In  the  development  of  SAINT,  a systems  approach  involv- 
ing a top  down  analysis  was  employed.  The  type  of  system  to  be 
modeled  was  defined  in  terms  of  missions.  The  purpose  of  the 
modeling  was  established  as  obtaining  mission  performance 
measures.  The  use  of  SAINT  allows  systems  designers  a new 
flexible  methodology  for  establishing  man/machine  design  trade- 
offs throughout  various  stages  of  system  development. 

A mission  consists  cf  a set  of  tasks  performed  by  a 
crew  of  operators  having  a complement  of  equipment  in  the  face 
of  environmental  factors.  Also  associated  with  the  mission  is 
a scenario  which  defines  the  phases  of  the  mission  and  the 
times  by  which  they  must  be  completed.  Performance  for  the 
mission  was  defined  in  terms  of  the  time  required  to  accomplish 
the  mission  and  whether  the  mission  was  accomplished  success- 
fully or  resulted  in  a failure.  These  performance  measures  are 
associated  with  the  terminal  or  sink  tasks  of  the  network  model 
of  the  mission. 

Given  the  above  specification,  network  concepts  were 
developed  by  which  tasks  are  modeled  as  nodes  and  a mission  is 
modeled  as  a set  of  tasks  linked  through  precedence  relations 
represented  by  the  branches  of  a network.  Operators  flow 
through  the  network  performing  those  tasks  which  are  assigned 
to  them  and,  in  so  doing,  consume  time.  Independent  variables 
that  affect  the  operators  performing  the  tasks  are  included  in 
the  model  through  parameters  and  functional  relationships. 
Resource  requirements  are  included  as  structural  aspects  of  the 
model.  Thus,  SAINT  can  be  used  to  model  and  analyze  diverse 
missions  involving  operators  performing  tasks. 

From  the  user's  standpoint,  SAINT  represents  a bottom- 
up  approach.  The  designer  or  system  engineer  as  a user  must 
define  the  tasks  of  a mission  and  the  relationships  that  exist 
between  tasks.  In  defining  the  tasks,  he  is  working  at  the 
elemental  level  which  permits  the  obtaining  of  data  about 
specific  tasks.  When  coJ.lecting  data,  the  user  need  not  be 
concerned  about  total  mission  performance  as  SAINT  is  designed 
to  do  this.  Thus,  SAINT  allows  the  user  to  concentrate  on 
specific  details  of  a task  and  from  such  information  SAINT 
integrates  the  data  to  obtain  mission  performance  estimates. 
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The  decomposition  of  an  overall  problem  into  its  ele- 
ments and  then  providing  a vehicle  to  integrate  the  elements 
into  system  performance  measures  is  in  the  true  spirit  of  the 
systems  approach.  SAINT  provides  this  capability.  As  with 
any  general  technique,  care  and  experience  are  necessary. 
Presumably  we  have  the  caution  to  proceed  slowly  and,  hope- 
fully, the  courage  to  gain  experience. 

The  primary  recommendation  resulting  from  this  research 
is  that  applications  of  SAINT  need  to  be  made.  Through  appli- 
cation, modifications,  deletions  and  extensions  are  anticipated. 
SAINT  has  been  designed  in  a modular  form  to  facilitate  such 
possibilities. 

With  regard  to  specific  areas  of  continuing  develop- 
ment, the  following  are  proposed:  1)  verification  of  the 

factors  and  relations  included  in  the  characterization  of  task 
performance;  2}  development  of  new  concepts  in  order  to  model 
tasks  that  require  continuous  monitoring,  queueing,  and  resource 
allocation;  3)  extend  the  treatment  of  task  type  and  the  method 
by  which  operators  are  assigned  to  tasks;  4)  extend  SAINT  to 
include  other  system  and  mission  performemce  measures  such  as 
reliability,  availability,  and'  cost  effectiveness. 
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